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1. Introduction 

Humans are involved in every man-machine system. More often accidents and systems 
failure are traced to human errors. As such humans play an important role in the overall 
reliability of engineering systems because various systems are interconnected by human 
links. Therefore, in order to have meaningful system reliability analysis, the reliability of 
the human element must be taken into consideration. 

Human reliability can be improved significantly by following human-factor principles 
during the system design phase. Additional enhancement may be obtained from careful 
selection and training of appropriate personnel. Appropriate design of the system and 
equipment also help to increase human reliability. However, even when selection and 
training are efficiently carried out and appropriate design features are incorporated, people 
are not always reliable. They make mistakes, and in some cases, their errors will lead to 
systems failure and accidents. 

In this research effort, the issue of human errors in the processing of the shuttle and other 
flight programs is investigated. Such events as sending the wrong command or assembling 
the wrong parts tend to recur despite efforts at prevention. In studying human errors, one 
of the important problems is how to represent the human variables quantitatively in 
mathematical models. Therefore, stochastic models to address the occurrence of human 
errors in certain systems are needed. This report, which was completed and submitted to 
KSC on June 23, 1999, presents such stochastic models. These models have never been 
used in this particular application before. 

The availability of probabilistic models of the processing work flow might offer the 
opportunity to analyze contributing factors and test process improvements that could 
reduce or eliminate these events. These models may enable us to predict trigger events 
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that lead to failure modes and affect human performance. The availability of technologies 
to improve situational awareness will increase systems safety. 

A human error is defined as a failure to perform a prescribed task or the performance of a 
prohibited action that could result in damage to equipment and property or disruption of 
scheduled operations. Various factors may lead to a human error. Some of these factor 
are inadequate lighting, high noise level, improper tools, stress, fatigue, and poor 
equipment design. 

In order to prevent errors, we must first be able to predict them. Therefore, the objective 
of this research effort is to establish probabilistic models substantiated by sound theoretic 
foundation to address the occurrence of human errors in the processing of the space 
shuttle and other flight programs. 

2. Human Variables 

Human errors may also be caused by human variables such as proficiency, fatigue, 
learning, stress reaction, group interaction variables, norms and goals, group 
identification, cohesiveness, social pressure, and morale. This topic is covered extensively 
in the open literature, see [2] and the reference therein, here we shed the light on two of 
such variables as examples, 

(A) Fatigue: Fatigue is one of the principal human variables which lead to errors. A 
definition of fatigue is the subjective residue of feelings of bodily discomfort and aversion 
to effort. Fatigue may be caused by long work shifts, insufficient rest, monotony (tedious 
sameness), surroundings (poor fighting, noise, atmospheric conditions), mental factors 
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(responsibility, worries, conflicts), illness and pain, eating habits, etc. It is generally 
considered a time-correlated disorder that affects performance in many ways such as: 


(a) Responses are made too late or too early, 

(b) responses are made too intensely, 

(c) occasional response omissions are typical, and 

(d) increased fatigue leads to decreased performance, and mean performance time 
decreases. 

For example, in the case of commercial airline pilots, the frequency of human error (e.g., 
forgetfulness, improper adjustment of controls, etc.) will increase if a pilot is fatigued. 
Acute fatigue is generally easier to identify and relieve. Chronic fatigue is a generalized 
response to stress over a period of time. Thus, cumulative effects of the work situation 
become important. 


(B) Stress: This is another important human variable that affect human performance and 
its reliability. There is a nonlinear relationship between human performance and stress: 
when the stress is moderate the performance is highest. Otherwise, at very low stress, the 
task will be unchallenging and dull and thereby human performance will not be at its peak. 
On the other hand, stress above a moderate level will cause human performance to decline. 
Reasons for the decline include, for example, worry, fear or other kind of psychological 
stress. Moderate stress may be defined as the level of stress enough to keep the human 
being alert. 
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3. Characteristics of Human Error 


There are some similarities between man (with multiple organs and functions) and a 
machine (with multiple components and functions) in terms of their proneness to failure, 
which leads to parallelism of methods of analysis in each. However, the human failure 
process has its peculiar features. Human errors are of random recurring type, whereas 
hardware failure condition is irreversible by itself. That is why hardware reliability is 
concerned with the first failure. A human may continually improves his performance from 
learning unlike his machine-counterpart. There are three important aspects of human 
error: 

a) the possibility of self-detection or detection by another person, 

b) the ability to be corrected or recovered, and 

c) its consequences. 

When an error is made, it may or may not be recognized by the operator as an error. If it 
is not recognized, then the operator cannot take any further action. If it is recognized, it 
may or may not be correctable. In most cases, operators are motivated to take action to 
correct errors if they are able. However, if the error is not correctable, the consequences 
must be considered. Such consequences may be major or minor. Major consequences 
would require the operator to take immediate alternative action, but minor ones may only 
require continued monitoring to see if further action is required at a later time. 
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4. Learning Curves 

A graphic profile of the learner's performance reflecting an increase of the speed and/or 
accuracy is called a learning curve. Such a curve plots some measure of performance 
(such as speed, accuracy, errors, hits, etc.) against some measure of the amount of 
practice (e.g. trials, days). Individuals can learn new working s kills ; groups can learn 
cooperative skills. The increased productivity resulting from learning a certain operation 
can influence the completion time of a task. The relationship between completion time 
and number of tasks completed is expressed by an exponential function 

T = an- b (1) 

where, 

n = number of tasks accomplished 
a = time required to complete the first task 
b = positive exponent associated with the learning rate 
T = the accumulated average time per task 

Each time the operation is repeated, the curve forecasts decrease in time. The decrease in 
time is the result of improved methods, procedures, or worker familiarization. 

Remark: If b = 0 no learning occurs. In case of forgetfulness or inattention, b < 0, and T 
increases in time. 


Definition: The Learning Rate 

The reduction ratio of the accumulated average times in doubling the number of tasks 
accomplished is defined as the learning rate r, 


r = 


a(2n)- b 

an _b 


= 2 -b 


( 2 ) 
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The learning rate remains relatively constant for a given individual, group, or industry. 
Therefore, 

u - iHI 

b Ln2 ( J ) 

In practical situations, r varies from 50% (fast learning) to 100% (no measurable 
learning). If forgetting occurs as bad habits are picked up, a theoretical learning rate could 
exceed the 100% limit. 


5. Modes of Error Detection 

People’s errors are brought to their attention in three ways: 

a) directly, they can find out for themselves through various kinds of self-monitoring, 

b) environmental indication that makes it very clear that they made an error, and 

c) indirectly, the error may be discovered by another person, who then tells them. 


6. Stochastic Models of Human Errors 

Probabilistic models of human performance in discrete and continuous tasks are developed 
in this section. The approach used in these models is to view the human as a whole (as a 
black box) with a finite number of unknown parameters. Once the structural model of the 
operator is chosen, the problem is reduced to one of parameter estimation. 
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Model 1 


Discrete Model 

Nonstationary Bernoulli Trials: These are Bernoulli trials with variable probabilities from 
trial to trial. In a sequence of a repetitive trials of a given task, a human can fail to 
perform a prescribed act or perform a prohibited act, thus causing a system failure. Here 
we assume that the probability of committing an error decreases as the number of trials 
increases in accordance to the learning curve theory. That is, the operator continually 
improves his performance from learning. 


Let {X i , X 2, X 3 , . . . , X n } bea finite sequence of mutually independent random 
variables taking the values 0 (No error), or 1 otherwise. Assume that the error 
probabilities are independent of the past performance record (previous tasks). 

Let p k =P(X k = 0 ), q k =P(X k = 1) = 1 — p k , and 

S n = the total number of errors in the first n independent trials 

= Ex k 

k=l 

The expected value of S n is 

M n = E[S „] = EE[X k ] = £q k 

k=l k=l 


The average probability of an error in n trials is 


£E{X k ] 
_ k=l 


Mu 

n 


( 4 ) 


A model shaped after the general learning curve can be constructed by setting the average 
probability of an error. Equation ( 4 ), equal to an exponential function in Equation similar 
to that in Equation (1), see [ 5 ], to obtain 
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A graph of the average probability of committing an error = a n b 

An expression for the error probability on the nth trial can be obtained from Equation (4), 

n n— 1 

Qn = X^Qk ~ X^Rk 

k=l k=l 

= a[n 1 - b -(n-l) 1 - b ] (6) 

The total expected number of errors in a fixed sequence of trials from trial number n i to 
trial n 2 is 

M„ 2 — M n ,_i = a[n 2 1-b - (ni - 1) 1-b ] (7) 


The human reliability that a prescribed sequence of successive trials from trial number 
n i through trial number n 2 is completed without errors is 

R( n !,n 2 ) = fl Pk = HO -qk) (8) 

k = iii k=ni 


8 


Parameter Estimation: 


Let mi = the number of errors occurred in the first n i trials 


m2 


Then, 


the number of errors occurred in the sequence of trials from trial 
number (n 1 + 1 ) through trial number n 2 


mi 

= anj 4 

(9) 

m 2 

= anj 4 — mi =an2 _b — an} 4 

(10) 

and 



mi 

_ n !~ b 


m 2 

nl 4 -nj- b 


m 2 n|- b 

= m 1 (n 2 _b - n }~ b ) 


mi 

^ n 2 ' 


m 1+ m 2 


or 



M mi T m2 ) 

= (1 - b) ln(ai) 


From which 



b 

__ 1 r ln mi— ln(mi+m 2 ) 1 

L In n !— In n 2 J 

(11) 


Now Equation (10), yields 
m 1+ m 2 = an \~ b 


or 

a = (mi+m 2 )n 2 S ' 1 (12) 
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Remarks: 1. If there is no learning r = 100% and, from equation (2), r = 2 -b , so b = 0. 
Therefore, from Equation (6), qi=q 2 =: q 3 = -- - = a, and the process degenerates into an 
ordinary Bernoulli trials (as expected). 

n 

2. For large values of n and moderate values of M n = X^fik * M n := A for large n, it 

k=l 

can be shown that S n , the distribution of the total number of errors in the first n 
independent trials is approximately Poisson, see [3]. 

P(S n = k) = , where an estimate of A (using Equation (5)) is 

A = an 1 "*. 
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Model 2 


Discrete Model 

As in model 1, we assume Bernoulli trials with variable probabilities from trial to trial. 

Here we assume that the probability of committing an error increases as the number of 
trials increases exponentially because the operator's performance is deteriorating due to, 
say, stress or fatigue. Since ^ is an average probability, it should be nonnegative and 
bounded above by 1, and in this case nondecreasing, so instead of Equation (5) we use 

^ = 1 -an' b 

or 

M n = n — an 1_b (13) 

where a > 0 and b > 0 are parameters to be estimated. The quantity (1 — a), 0 < a < 1, 
represents the error probability on the first trial (n = 1). 



A graph of an increasing (average) probability of committing an error ^ = 1 — a n ~ b 
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In this case an expression for the error probability on the nth trial can be obtained from 
Equation (13), . 

n n— 1 

fin = Sfik — Sfik 
k=l k=l 

= n - an 1 " 15 - [n - 1 -a(n- l)‘- b ] 

= 1 -a[n'- b -(n- l)'- b ] (14) 

The total expected number of errors in a fixed sequence of trials from trial number n i to 
trial number n 2 is 

M„ 2 — M n ,_i = n 2 — n ! -a(n 2 1_b + n 1 1_b ) (15) 

The human reliability that a prescribed sequence of successive trials from trial number 
n 1 through trial number n 2 is completed without errors is 

R(n i,n 2 ) = II Pk = 11(1 -qk) (16) 

k = ni k=ni 


Parameter Estimation: 

Let M 1 = the number of errors occurred in the first n 1 trials 


Then, 


M 2 = the number of errors occurred in the sequence of trials from trial 

number (n 1 + 1 ) through trial number n 2 


Mi = n 1 — a n } b 


(17) 


Mj+M 2 = n 2 — a n 2 b 


and 


(18) 
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a = (n 2 - Mi - M 2 )nf - 1 


( 20 ) 


Remark: If the average error probability ^ does not increase then, from its definition, b 
= 0 . Therefore, from Equation (1 4), q i = q 2 = q 3 = . . . = (1 - a), and the process 
degenerates into an ordinary Bernoulli trials (as expected). 
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Model 3 


Continuous Time Model (Decreasing Mean Value Function) 

The system is being improved over time or the operator continually improves his 
performance from learning in continuous time tasks. Learning is assumed to take place in 
a systematic way compatible with the general learning curve. 

Assumptions: 1 . Human errors occur at random times, and each error is treated as an 
event without duration. The number of human errors by time t is denoted by N(t). 

2. The operator continually improves his performance from learning. 

3. The number of human errors during nonoverlapping intervals do not affect each other. 
This means that the counting process {N(t): t > 0} has independent increments. 

Definition: The counting process {N(t): t > 0} is called a nonhomogeneous (or non 
stationary) Poisson process, see [6], with intensity function A(t) , t > 0, if 

(a) N(0) = 0 

(b) (N(t): t > 0} has independent increments, 

(c) In any time interval (no matter how small) there is a positive probability that an 
event will occur (but is not certain), i.e., for any t > 0 , 0 < P(N(t) > 0) < 1 . 

(d) In sufficiently small intervals, at most one event can occur, i.e., it is not possible 
for events to happen simultaneously. 

Let M(t) = E[N(t)] = Mean Value function 

The intensity function A(t) is the rate of change of the mean value function M(t), i.e., 

A(t) = or M(t) = Jo A(s) ds. The distribution of the number of “error events” in 
the an interval (t, t + s] is given by 

P(N(t + s) - N(t) = j) = e ~ (M(t+s) (M(t+s) ~ M(t))J , j > 0 (21) 
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To construct a model fashioned after the general learning curve theory, see [5], assume 
that the time-averaged mean value function takes the form 

~ = A t - a , t > 0 , a > 0 (22) 

The parameters A > 0 and a > 0 are to be estimated. The parameter A represents the 
mean value (expected number) of errors at the first unit time, t = 1 . 



A graph of time-average mean value function = A t _ “ 

The counting process (N(t) : t > 0} is a nonhomogeneous Poisson process 
(or a Poisson process with nonstationary increments) with mean value function (or 
expectation function) 

M(t) = A t 1_a (23) 

Therefore, 

P{N(t 2 ) - N(t0 = k} = ( A M (ti.t 2 )) k e — AM( t| ,t 2 ) 5 ( 24 ) 

for any 0 < ti < t 2 , k > 0 , 

where 

AM(ti ,t 2 ) = M(t 2 ) — M(ti) 

= \(t\~ a - t}-°) (25) 


15 



The human reliability that a given task of specified time duration [t| ,t 2 ] is performed 
successfully without any errors is 

R(ti,t 2 ) = P{N(t 2 ) - N(t]) = 0} = e-^ a (26) 

Remark : When there is no learning a = 0 , M(t) = At , and the counting process 
{N(t):t > 0} degenerates into homogeneous Poisson process (with stationary 
increments). In this case, the human reliability for the time interval [0,t] reduces to 

R(0,t) = e~ At (27) 


Parameter Estimation: 

Let mi = Number of errors occurred in the time interval [0,t , ] 
m 2 = Number of errors occurred in the time interval [t i ,t 2 ] 


Then 

mi = At 1 1-£ * 

m 2 = A t 2 ~ a — mi 

Solving simultaneously, we obtain: 


a 


= 1 




or 


a 


= 1 


Inm i - ln( m i + m 2 ) 
lnt i - lnt2 


(28) 

(29) 


(30) 


and 


~ a —1 

A = (mi+m 2 )(t 2 ) 


(31) 
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Model 4 


Continuous Time Model (Increasing Mean Value Function) 

Here the operator's performance is continually deteriorating due to certain factor such as 
long work shifts, insufficient rest, monotony (tedious sameness), surroundings (poor 
lighting, noise, atmospheric conditions), mental factors (responsibility, worries, conflicts), 
illness and pain, eating habits, etc. 

Let 

N(t) 1 Number of errors by time t 

The counting process {N(t) : t > 0} is a nonhomogeneous Poisson process 
(or a Poisson process with nonstationary increments). In order to construct a probabilistic 
model of human errors which accounts for deteriorating performance, the time-average 
mean value function is assumed to be exponentially increasing of the form 

=1 — At _a ,t>0,a>0, (32) 

The parameters A>0,a:>0,aretobe estimated. The quantity (1 — A) represents the 
mean value (or expected number) of errors committed by time t = 1 . 



A graph of time-average mean value function pp = 1 - Ar° 
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The counting process (N(t): t > 0} is a nondecreasing Poisson process (or a Poisson 
process with nonstationary increments) with mean value function 

M(t) =t - At 1 "® (33) 

Therefore, 

P{N(t 2 )-N(ti)=j} = (4M ( t | i ,l2)) i e -AM(t 1 ,t 2 ) ? (34) 

for any 0 < 1 1 < 1 2 > j > 0 , 

where 

AM(t j ,t 2 ) - M(t 2 ) — M(t j) 

= (t 2 - tj) - A(t>~“ - t}-“ ) (35) 

The human reliability, which is the probability that a given task of specified time duration 
[t 1 ,t 2 ] is performed successfully without any errors, is therefore 


R(t 1 ,t 2) =P{N(t 2 )-N(t,) = 0 } = e -[(t 2 -t,)-A(tJ-“-t{-“) (36) 

Remark: If a = 0 (no cause of deteriorating performance), M(t) = ct , where c = 1 — A 
is a constant. In this case the counting process (N(t): t > 0} degenerates into 
homogeneous Poisson process (with stationary increments), and the human reliability for 
the time interval [0,t] reduces to 

R(0,t) = e - ct (37) 
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Parameter Estimation: 

Let mi = Number of errors occurred in the time interval [0,t , ] 
m 2 = Number of errors occurred in the time interval [t 1 ,t 2] 

Then 


mi 

= ti -At/-* 

(38) 

m 2 

= 1 2 — A t 2 1- * — mi 

(39) 

Solving simultaneously as before we obtain: 


a 

1 r ^ ] — m | 1 

_ L t 2 -(m 1 +m 2 )J 

i*H> 


or 


(40) 

a 

_ 1 ln(t 1 — m 1) — ln(t2 -nn — m 2 ) 

Inti — lnt 2 


and 



A 

a —1 

= (t 2 - mi -m 2 )t 2 

(41) 
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Model 5 


Continuous Time Model 
Hazard Rate Technique 

The general human performance reliability function for continuous time tasks can be 
developed the same way as the case of the classical reliability function. Examples of 
continuous time tasks performed by humans are aircraft maneuvering, missile countdown, 
and monitoring. Two methods are presented here, and it will be shown that the two 
methods lead to the same result. We first recall basic definitions 


Definition 1: Hazard Rate Function (or Human Error Rate) 

Consider a positive continuous random variable X(t) , e.g. the lifetime of some item or 
time to failure, having distribution function F and probability density function f. The 
hazard rate (human error rate, or failure rate) function h(t) of F is defined by 

h (t) = r=F(0 (42) 


Definition 2: The Human Performance Reliability at Time t, R(t), is the probability of 
performing a task without errors till time t. Thus 

R(t) = P(X > t) = 1 - F(t) (43) 

The time-dependent human error rate or hazard rate function h(t) is usually (using 
Equation (42)) written as 


h(t) = _-l_dR{t) 
nw R(t) dt 


Integrating both sides over the time interval [0, t], we obtain 
Jo h(s) ds = - / 0 l ^ dR(s) , where R(0) = 1 . Thus, 


R(t) 


Jo h ( s ) ds 


(44) 


(45) 
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The reliability expression in Equation (45) holds whether the human error rate (or hazard 
rate) is a constant or nonconstant. We note here that the human error rate could be 
described by probability distributions such as exponential, Rayleigh, Weibull, normal, or 
bathtub distributions. For instance, the Weibull density function is known to fit the 
experimental data in the case of vigilance task, see reference [4]. 

If we model N(t) the number of human errors that occur in the time interval [0, t] as a 
Markov process, then the following assumptions are appropriate: 

(a) N(0) = 0 

(b) Independent increment assumption: The number of errors that occur in disjoint 
time intervals are independent. 

(c) Stationary: The distribution of the number of errors that occur in a given 
interval depends only on the length of that interval and not on its time-location, 
i.e., the probability distribution of N(t + s) — N(s) is the same for all s > 0 
and t > 0. 

(d) P{N(At) = 1 } = A At + o(At) 

(e) P{N(At >2} =o(At) 

Remarks: 1. Assumptions (a) through (e) mean that the process {N(t): t > 0} is a 
Poisson process (a type of Markov process) having intensity parameter A. 

2. For s > 0 and t > 0, the random variable N(t + s) — N(s), representing the number 
of human error over the interval (s, s + 1], has a Poisson distribution with mean At , i.e., 

P{N(t + S ) - N(s) = k} = ^ 1 ) k k , e " A1 for k = 0, 1, — (46) 
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Let P 0 (t) be the probability that a human is performing a task continuously at time t 
without errors, then Po(t) = P{ N(t) = 0 } and a differential equation for Po(t) can be 
constructed, using the above assumptions, as follows: 


P 0 (t + At) = P{N(t + At) = 0} 

= P{N(t) = 0, N(t + At) - N(t) = 0} 

= P{N(t) = 0}P{N(t + At) - N(t) - 0} 

= P 0 (t) [1 - P (N( At) = 1} - P{N(At > 2}], 
using assumptions (d) and (e), 

= P 0 (t)[l - AAt + o(At)] 

Thus, 

At AP 0 (t) + 

Now, letting At — > 0 , we obtain 

p o(t) = - AP 0 (t) , where P 0 (0) = 1. 

Integrating, we obtain 

P 0 (t) = e~ At (47) 


If the intensity of human error rate A is not a constant Equation (46) becomes 

P 0 (t) = e ~io A ( s ) ds (48) 

We note that Equation (48) is consistent with Equation (45), since the human reliability 
function R(t) = Po(t), the probability of committing no errors. Therefore, the two 
methods lead to the same result. It follows that the probability of committing at least one 
human error is 


Ph(t) = 1 — e At , if A is a constant 


Ph(t) = 1 — e Jo A ( s ) , if A is not a constant 


(49) 
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Example: Human error rate associated with Weibull distribution. 
The Weibull distribution function has the form 



R(t) = e * ds = e ~ (s) ^ , t > 0 (51) 

where a and (3 are parameters to be estimated using appropriate statistical technique, such 
as the maximum likelihood estimation method, see [1]. 


A(/)= (/9/e) (//«)»-• 



0 I 2 

Graphs of the Weibull hazard functions h(t) 
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Remarks: 1. In the definition of hazard rate function h(t) , if X(t) denotes the number 
of error occurrences in a specified interval [0, t], then it can be shown that X(t) is a 
nonhomogeneous Poisson process with mean value function M(t), where 
M(t) - Jo h(s) ds . 

2. Comparing Equations (45) and (48), we see that h(t) = A(t). The time-dependent 
human error rate is the intensity function of the nonhomogeneous Poisson process (see 
definition in Model 3). 

3. An important choice for a nonhomogeneous intensity function is 

h(t) = A(t) = 
which gives 

M(t) - = (£)* 

In this case the time to first human error occurrence follows a Weibull distribution with 
parameters a and (3. 

4. The intensity parameter A(t) = “(a)' 8-1 is an increasing function of t if 0> l,a 
decreasing function of t if /3 < 1 , and a constant function of t if f}= 1 . 

5. The (3 < 1 case might apply to a developmental situation in which the system is being 
improved over time. This is similar to the situation in model 3 where the performance is 
being improved due to learning. 

6. The [3 > 1 case might apply to a situation where the performance is deteriorating as 
that in model 4. 

7. For any hazard rate function (human error rate) h(t), the associated distribution and 
density functions can be obtained by integrating Equation (42) and using f(t) = 

to get the relationship 

F(t) = 1 - exp[ - /‘ h(s) ds] 
or 

f(t) - h(t) exp[ - JjJ h(s) ds]. 
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